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(54) Method and apparatus for blind separation of delayed and filtered sources 



(57) A method of recovering source signais (y1 . y2) 
from an equal number of mixed signals (x1 , x2) inctud- 
ing components of the source signals. Channel one (xl) 
and two (x2) mixed signals are multiplied by channel 
one (w1) and ^M3 (w2) adaptive weights to produce 
channel one and two product signals, respectively. A 
channel one filtered feedback signal is generated from a 
channel two approximation signal (u2) and a channel 
two filtered feedback signal is generated from a channel 
one approximation signal (u1). The channel one filtered 



feedback signal Is added to the channel one product 
signal to produce the channel one approximation signal 
(u1) and the channel two filtered feedback signal is 
added to the channel two product signal to produce the 
channel two approximation signal (u2). A nonlinear 
function (35. 36) is applied to the approximation signals 
(u1 . u2) to produce output signals (y1 , y2). The adaptive 
weights and the filtered feedback signals are adjusted 
(37) to maximize entropy of the output signals (y1. y2). 
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Description 

Reld of the Invention 

The present invention pertains to methods for sep- 
arating signal sources and nrv}re specif ically to the blind 
separation of multiple sources. 

Background of the Invention 

Blind source separation denotes observing mix- 
tures of independent sources, and by making use of 
these mixed signals only and nothing else, recovering 
the origina! or source signals. 

The separation of independent sources from an 
array of sensors Is a classic but difficult problem in sig- 
nal processing. Generally, the signal sources as well as 
their mixture characteristics are unknown. Without 
knowledge of the signal sources, other than a general 
assumption that the sources are independent, the sig- 
nal processing is commonly known in the art as the 
"blind separation of sources". The separation is "t>lind" 
because nothing is known about the independent 
source signals. 

A typical example of the blind separation of source 
signals is where the source signals are sounds gener- 
ated by two independent sources, such as two (or nnore) 
separate speakers. An equal number of microphones 
(two in this example) are used to produce mixed signals, 
each composed as a weighted sum of the source sig- 
nals. Each of the source signals is delayed and attenu- 
ated in some unknown amount during passage from the 
speaker to a microphone, where It is mixed with the 
delayed and attenuated components of the other source 
signals. Multi-path signals, generated by multiple reflec- 
tions of the source signals, are further mixed with direct 
source signals. This is generally known as the "cocktail 
party" problem, since a person generally wishes to lis- 
ten to a single sound source while filtering out othei 
interfering sources, including multi-path signals. 

Those skilled In the signal processing arts have 
been eager to solve blind source separation problems 
because of their broad application to many communica- 
tion fields. In the cellular telecommunications art. for 
example, a receiver must eliminate multi-path signals to 
avoid unacceptable levels of interference. 

Jutten and Herault ("Space or Time Adaptive Signal 
Processing by Neural Network Modules", Neural Net- 
works for Computing. Snowbird, UT, J. S. Denker, Ed., 
AlP Ck)nference Proceedings 151, pp. 207 - 211, 1986) 
first introduced a simple neural network with adaptive 
separation capability A detailed discussion of the Jut- 
ten-HerauIt network, refer to Pierre Ck)mon, et al. "Blind 
Separation of Sources, Part II: Problem Statement", 
Signal Processing 24 (1). pp. n - 20 (1991). Comon et 
al. observe that the Jutten-Herault network functions by 
searching for common zeros of N functionals through 
pipelined stochastic iterations. Comon et al. show that 
the Jutten-Herault network relies on the assumed inde- 



pendence of the mixed signals, which follows from the 
assumption of independent source signals only if the 
nruxed signals are linear combinations of tiie source sig- 
nals. Comon et al. note that any introduction of non-lin- 

5 earity changes the problem to one requiring the solution 
of an overdetermined system on non-linear equations 
with several variables. 

Generally, the prior art is concerned with instanta- 
neous nruxtures but cannot handle delayed and filtered 

10 sources. For example, Ptatt and Faggin (Networks For 
the Separation of Sources That Are Superimposed and 
Delayed", Ad^nces in Neural Informatbn Processing 
Systen)S, Vol. 4, Morgan-Kaufmann, San Mateo. Calif., 
1992) have proposed a network that modifies the Jut- 

15 ten-Herauh network to also estimate a matrix of time 
delays while estimating the Jutten-Herault network mix- 
ing matrix. Piatt and Faggin have proposed a new net- 
work to separate source signals that are mixed either 
with time delays or through filtering. However, Piatt and 

20 Faggin also note that their learning technique has multi- 
ple stable states and they cannot predict convergence 
to a solution (\.e, separate source signals) except 
through experimentation. 

A blind source separation system that works under 

25 real world conditions would have a multitude of applica- 
tions: array processing, speech signal enhancement in 
the presence of noise, speaker separation in teleconfer- 
encing situations (cocktail party problems), elimination 
of multipath reverberation distortion, reducing intersym- 

30 bol interference, and others. Cun-ent algorithms all have 
shortcomings that prevent their successful application 
to many real world situations, such as wideband audio 
recordings. 

Accordingly, the provision of a blind source separa- 
35 tion system that operates under real world conditions is 
highly desirable. 

It is a purpose of the present irwention to provide a 
new and improved blind source separation system 
It is another purpose of the present invention to pro- 
40 vide a new and Improved blind source separation sys- 
tem that operates under real world conditions 

It is a further purpose of the present invention to 
provide a new and improved Ijlind source separation 
system that has the capabilities of dealing with sources 
45 that have been delayed witii respect to each other. 

It is still a further purpose of the present invention to 
provide a new and improved blind source separation 
system that is capable of separating sources which 
include a sum of multipath copies of the sources dis- 
50 torted by tiie environment. 

Summarv of the Invention 

The above problems and others are at least par- 
55 tially solved and the above purposes and others are 
realized in a novel method of recovering source signals 
from an equal number of mixed signals including com- 
ponents of the source signals. As a first step of the 
method, channel one and two mixed signals are multi- 
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plied by channel one and two adaptive weights to pro- 
duce channel one and two product signals, respectii/ely. 
A channel one filtered feedback signal is generated 
from a channel two approximation signal and a channel 
two filtered feedback signal is generated from a channel 
one approximation signal. The channel one filtered 
feedback signal is added to the channel one product 
signal to produce the channel one approximation signal 
and the channel two filtered feedback signal is added to 
the channel two product signal to produce the channel 
two approximation signal. A nonlinear function is 
applied to the approximation signals to produce output 
signals. The adaptive weights and the filtered feedback 
signals are adjusted to maximize entropy of the channel 
one and channel two output signals. 

In a preferred embodiment of the present invention 
the step of multiplying tiie channel one mixed signal by 
the channel one adaptive weight to produce the channel 
one product signal includes multiplying the channel one 
mixed signal by a series of different weights associated 
with a series of different delays and doing a summation 
to produce the channel one product signal arxJ the step 
of multiplying the channel two mixed signal by the chan- 
nel two adaptive weight to produce the channel two 
product signal includes multiplying the channel two 
mixed signal by a series of different weights associated 
with a series of different delays and doing a summation 
to produce the channel two product signal. Also, the 
step of generating the channel one filtered feedback sig- 
nal includes multiplying the channel two approximation 
signal by a series of different weights associated with a 
series of different delays and doing a summation to pro- 
duce the channel one filtered feedback signal and the 
step of generating the channel two filtered feedback sig- 
nal includes multiplying the channel one approximation 
signal by a series of different weights associated with a 
series of different delays arxi doing a summation to pro- 
duce tiie channel two filtered feedback signal. 

Brief Description of tiie Dra\Ann9R 

Referring to the drawings: 

FIG. 1 is a semi-schematic representation illustrat- 
ing the t)lind source separation problem; 
FIG. 2 illustrates several simplified waveforms 
present in the structure of FIG. 1 : 
FIG. 3 is a simplified block/schematic diagram of a 
prior art blind source separation system; 
FIG. 4 illustrates several simplified waveforms 
present In the structure of FIG. 3; 
FIG. 5 illustrates a simplified block/schematic dia- 
gram of a blind source separation system in accord- 
ance with the present invention; and 
FIG. 6 illustrates another simplified block/schematic 
diagram of a blind source separation system In 
accordance with the present invention. 



Description of the Prefeffed gmboriimffr^ 

The basic problem of separating blind sources can 
be seen most clearly by referring to the simplified repre- 

5 sentation of FIG. 1. In the specific examples utilized 
hereafter, the sources will be signals representative of 
sounds, but it should be understood that the source sig- 
nals could be anything capat^le of being sensed and 
processed, such as light signals, audio signals, RF sig- 

10 nais. vibration measurements, or any system that might 
include crosstalk or similar types of interference. In FIG. 
1 , a t^ind source separation system is represented by a 
classic black box 10 containing (at this time) unknown 
components. A pair of microphones 11 and 12 provide 

IS two inputs to black box 10, which inputs are derived 
from two separate independent sources Si and S2. 
Microphone provides a first mixed signal 
aiiSi+ai2S2 and microphone provides a second mixed 
signal a2iSi+a22S2. As will be understood, tiie "a's" in 

20 the mixed signals represent some unknown fixed ampli- 
tude. Black box 1 0 only has access to the two Input sig- 
nals and must separate them into the two original 
source signals St and Sg. 

In a very simplified example, source signals Si and 

21 S2 are represented, in FIG. 2. by pulses (rectangular 
wavefbms) 13 and 14, respectively, with pulse 14 being 
negative, or the opposite of pulse 13. The first mixed 
signal applied to the first input of black box 10 is repre- 
sented by waveform 15, which includes a portion (equal 

30 to one) of pulse 13 and a portion (equal to one half in 
this simplified example) of pulse 14. Similariy. the sec- 
ond input of black box 10 is represented by waveform 
16, which includes a portion (equal to one) of pulse 14 
and a portion (equal to one halO of pulse 13. It follows 

35 that black box 10 must subtract a portion of pulse 14 
from the portion of pulse 13 in the upper channel to 
arrive at a pure source signal Sv Also, black box 10 
must subtract a portion of pulse 13 from the portion of 
Dulse 14 in the lower channel to arrive at a pure source 

40 signal S2. If the portions of pulse 14 and pulse 13 sub- 
tracted from the portions of pulse 13 and pulse 14, 
respectively, are exactiy correct pure source signals at 
the outputs of black t>ox 10 will be achieved. However, 
the problem is to find a criterion that determines when 

4S the outputs are separated. 

Recentiy. Bell and Sejnowski described that a pos- 
sible criterion for blind source separation is mutual infor- 
mation (A. J. Bell and T. J. Sejnowski, Blind Separation 
and Blind Deconvolution: An Information Theoretic 

so Approach". Proc, ICASSP, pp. 3415 - 3418, Detroit Mi, 
May 9 - 12, 1995 and A. J. Bell and T. J. Sejnowski, An 
Information-maximization Approach to Blind Separation 
and Blind Deconvolution". Technical Report lNC-9501. 
USCD. Institute for Neural Computation. Feb. 1995). A 

55 simplified block/schematic diagram of the Bell and 
Sejnowski blind source separation system is illusti-ated 
in FIG. 3. 

Refemng specifically to FIG. 3, two sensors 19 and 
20 receive two mixed signals, represented as X| and x^. 
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from unknown sources. Mixed signal is muttiplied by 
a weight ^ and applied to a sunvning circuit 21 . Mixed 
signal xy is also multiplied by another weight w^2 a^td 
applied to a summing circuit 22. Similarly, mixed signal 
X2 is multiplied by a weight W22 and applied to a sunv 5 
ming circuit 22. Mixed signal is also multiplied by 
another weight and applied to summing drcuit 21. 
Bias weights wqi and Wq2 are also applied to summing 
circuits 21 and 22, respectively, to adjust the mean val- 
ues of the sums. Output signals from summing circuits 
21 and 22 are then applied to output circuits 23 and 24. 
respectively, which then pass them through a nonlinear 
function and supply separated source signals y/ and 

Bell and Sejnowski proposed to learn the various 
weights (W) by minimizing the mutual information 
between components of vector 

y{t) = 9(u(t)) , where u is the vector or output signals 
from summing circuits 21 and 22. and p is a nonlinear 
function approximating the cumulative density function 
of the sources. Bell and Sejnowski showed that for pos- 
itively kurtotic signals (like speech) minimizing the 
mutual information between conponents of k is equal to 
maximizing the entropy of y, which can be written as 
H(y) = -E[/n{/y(y))] . where fy<y) denotes the proba- 
bility density function of y. Denoting the determinant of 
ths Jacobian of the whole net by | J|. fy(y) can t>e written 
as ^y(x)/|«/| (Jacobian is a matrix with entries of 



Now. maximizing the entropy of the output signals leads 
to maximizing Elln\J\], which in turn can be developed 
into the following stochastic gradient ascent rule using 
instances of x{f) and y{t) instead of using the expecta- 
tion: 

AWo^ (l-2y(0)^(0 ^HW^y^ . 

Aw^oc 1.2y(0. 

To derive the above adaptation rule. 9{y) = l/(i+e"^) 
was used as the nonlinear function to approximate the 
cumulative density function. 

There are several obstacles to applying this and 
Jutten-Herault algorithms to real world situations. These 
include the effect of noise to successful learning of the 
separating solution, possibly an unknown numk^er of 
sources (especially noise sources), and the assumption 
that the source signals are stationary. Most notable is 
the assumption of the simultaneous mixing of the 
sources. In any real-world recording, where the propa- 
gation of the signals through the medium is not instan- 
taneous (like sound through air or water), there will be 
phase differences between the sources in the mixtures. 
This is illustrated in the several simplified waveforms of 
FIG. 4. Sources 13 and 14 (previously described in con- 
junction with FIG. 2) are mixed to produce first and sec- 



ond mixed signate 25 and 25. However, in this instarice 
the portion of signal 14 mixed with signal 13 is delayed 
by some unkrx>wn anx>unt 

Similarly, the portion of signal 13 mixed with signal 14 is 
delayed by some unknown amount. As can be seen 
from waveforms 27 and 28. separated sources can not 
be achieved as a lin^r cdmtjihation of the mixtures. 
Current blind source separation systems can not toler- 
ate these delays. A related problem is the muttipath 
onrival of the signals. In general, each sensor is not 
observing just a clean copy of the source signal, but a 
sum of nuiltipath copies distorted by the environment, 
for example, by the inpulse response of a room. 

Referring rx>w to FIG. 5, a simplified block/sche- 
matrir diagram of a Sind source separation system 30 in 
accordance with the present invention is illustrated. To 
understand the operation of system 30. assume for sim- 
plicity two sources yy and y^ and their two mixtures X| 
and x^. It will of course be understood that the following 
description can be generalized to any number of 
sources and their mixtures. Channel one imixed signal 
Xf is multiplied by a channel one adaptive weight to 
produce a channel one product signal which is applied 
to a summation circuit 32. Also, channel two mixed sig- 
nal X2 is multiplied by a channel two adaptive weight W2 
to produce a channel two product signal which is 
applied to a summation circuit 33. As explained previ- 
ously, bias weights wqi and W02 ere also applied to 
summation circuits 32 and 33, respectively, although in 
some special instances these signals may be ignored oi 
built into the other components. 

The output signals of summation circuits 32 and 33 
are approximation signals and U2, respectively, 
which are utilized to generate filtered feedback signals 
that are then applied to summation circuits 32 and 33. 
respectively. In this specific embodiment, the channel 
one filtered feedback signal is generated by delaying 
channel two approximation signal U2 by a delay and 
multiplying the delayed signal by a weight vv/^- Similarly, 
the channel two filtered feedback signal is generated by 
delaying channel one approximation signal Ui by a 
delay d2i and multiplying the delayed signal by a weight 
W2i. Approximation signals U|. anti U2 are also applied 
to output circuits 35 arxi 36. which pass them through a 
sigmoid function, to produce channel one and channel 
two output signals y^ and y^. The output signals are uti- 
lized in an adjustment circuit 37 to adjust channel one 
adaptive weight Wj, the channel one filtered feedback 
signal, channel two adaptive weight W2, and the chan- 
nel one and two feedback weights and the delays to 
maximize entropy of the channel one and channel two 
output signals yj and y^ and, thereby, recover first 
source signal as the output signal y? and secorxl source 
signal as the output signal y^. 

System 30 thus computes the following, where 
are the outputs before the nonlinearities, and wqi are 
the bias weights: 

£/,(0= WjX^{t)'^W^2^20'<^12)+^01 
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y,(0 = a(«/,{0) 



where p is the logistic function g{u) = 1/(1+e' ) . g is 
also referred to as a sigmoid function. 

The nnutual information between outputs y/ and 
is minimized by maximizing the entropy at the outputs, 
which is equal to maximizing E[/n| J|]. The determinant 
of the Jacobian of the network is now 



u\-^L^ 3y^ . . 



(1) 



10 



90 ^w^w^) 



The adaptation rule for ivj becomes the following from 
equation (2) atXTve (similarly for wg }: 



(4) 



The bias adaptation is Awoi cc l-2y/. The role of these 
weights and biases is to scale and to shift the data so as 
to maximize the information passed through the sigmoid 
IS function g. 

For the partial derivatives are as follows: 



/n|J! = yn{y,) + ln(y2)+ ln(D) 



where 



du^du^ du^dUp . dy, 

0 = (a7;83?;-a3?;57f)='^i'^2->'i 



and 



3/2 
2 



The adaptation rule for each parameter of the network 
cab now be derived by confuting the gradient of In\J\ 
with respect to that parameter. For w^ the following is 
obtained 



For the logistic function 
1 9/1 



2C 



25 



35 



1-2y,. 



Thus, for the partial derivatives: 



= (1 -2yi)y^ x^. 



(1 .2y2)y2 0 = 0. 



(3) 



50 



55 



3yi _ ^y^^u^ 

dw^2 " ^y'i^u^dw^2 



(^-2y,)y,U2(i'd12). (5) 



dy^ ^ By 2 ^y29^2 
9w,2 By2^U2^w^2 



0-2y^)y2 0 = 0 



30 9(*VtW2) 



div 



12 



«0 



12 



50 Thus the, adaptation for w^^ is the following (similarly 
for W21)' 



AWj^oc (1-2y,)Ujp(t-c/,2). 
Aw^y « (1-2y2)u,(t-tf2?). 



(6) 



These rules decorrelate the present squashed output y/ 
from the other source uj at delay d^-. which is equivalent 
to separation. Note that in equations (5) and (6) the time 

40 indices of Uf and are given in parentheses, whereas 
for all other variables the time is implicitly assumed to be 
t Alt the partial derivatives starting from equation (1) 
are also taken at time instance t, which is why it is not 
necessary to expand the cross partial derivatives recur- 

45 sively backwards into time. 

The partial derivatives for the delay di2 are: 



By\ By\by,du, . 
Bd72-By,Bu,Bd,,-^' 2y,)y,w,^ 



(-t/2(t-cy,2)), 



3/2 _ 3/2 3/2^^2 
dd^2 " ^y2^^2^d^2 



(i-2y2)y2 0 = o. 



3D Hw^w^) 



dw 



12 
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which takes advantage of the fact that 

The adaptation mles tor-the delays i3ecom6 the fo^^ 
ing (again, only the time indices for u,- are explicitiy wift- 
ten): 

Ad 12 « -(1-2/,) w,2i>2(t-<y,2). (8) 
Ad 21 « '0-2y2)w2jU^(i-d2i). 

It is remarkable that e/ery adaptation rule is local, that 
is. to adapt a weight or a delay in a branch of the net- 
work, only the data coming in or going OLrt of the branch 
are needed. Generalization to N mixtures can thus be 
done simply by substituting other indices for 1 and 2 in 
equations (b) and (8) and summing such terms. 

Ag can be seen by referring to FIG. 6. a simplified 
block/schematic diagram of another blind source sepa- 
ration system 40 in accordance with the present inven- 
tion is illustrated. System 40 receives mixed signals 
and X2 at inputs to adaptive filters 42 and 43. respec- 
tively. Within these filters, channel one mixed signal Xf 
is essentially multiplied by a series of different weights 
associated with a series of different delays and a sum- 
mation is done in adaptive filter 42 to produce a channel 
one product signal that is applied to a channel one sum- 
mation circuit 43. Also, channel two mixed signal is 
essentially multiplied by a series of different woghts 
associated with a series of different delays and a sum- 
mation is done in adaptive filter 43 to produce a channel 
one product signal that is applied to a channel one sum- 
mation circuit 44. Further, as explained previously, bias 
weights wpi and wq2 are also applied to summation cir- 
cuits 44 and 45. respectively, although in some special 
instances these signals may be ignored or built into the 
other components. 

The output signals of summation circuits 44 and 45 
are approximation signals and U2, respectively, 
which are utilized to generate filtered feedback signals 
that are then applied to summation circuits 45 and 44. 
respectively. In this specific embodiment, the channel 
one filtered feedback signal is generated by passing 
channel two approximation signal U2 through another 
adaptive filter 46 where U2 is essentially multiplied by a 
series of different weights associated with a series of 
different delays and a summation is done in adaptive fil- 
ter 46 to produce a channel one filtered feedback signal 
that is applied to channel one summation circuit 44. 
Also, the channel two filtered feedback signal is gener- 
ated by passing channel one approximation signal 
through another adaptive filter 47 where is essen- 
tially multiplied by a series of different weights associ- 
ated with a series of different delays and a summation is 
done in adaptive fitter 47 to produce a channel two fil- 
tered feedt>ack signal that is applied to channel two 



summation circuit 45. Approximation signals U| and U2 
are also appGed to output circuits 48 and 49 which pass 
Ui and U2 through nonlinearities to produce output sig- 
nals yi and y?. The output signals are utilized in an 

5 adjustment cffcuit 50 to adjust channel one and channel 
two adaptive filters 42, 43. 46 and 47, to maximize 
entropy of the channel one and channel'two butixrt sig- 
nals Yi and and. thereby, recover the first source sig- 
nal as the output signal y^ and the second source signal 

10 as the output signal y^ 

While adaptive delays suffice for some applications, 
for most audio signals they are not enough. The acous- 
tic environment (e.g. a room) inposes a different 
impulse response between each source .and micro- 

15 phone pair. Moreover, the microphones may have differ- 
ent characteristics, or at least their frequency response 
may differ for sources in different directions, Tc over- 
come these disadvamages, blind source separation 
system 40 of FIG. 6 is utilized, the operation of which is 

20 explained by modeling it as the convolved mixtures set 
forth below. Foi simplicity, two sources in the z-trans- 
form domain are shown, but it will be understood that 
this can again be generalized to any number of sources. 

25 X,(z)« A„(z)S,(z) + A,2(z)S2(z), (9) 

X2{Z) = A22(Z)S2(Z) + A2i(z)S,[Z), 

where Aij are the z-transforms of any kind of filters and 
30 Si and are the sources. Solving for the sources S in 
terms of the ntixlure signals X, and X^: 

S,(z) lA22lz)X,(z) - A2i(z)X2{z))/G(z). (10) 

35 S2{z) = (A,,(z)X^(z) - A ,2{z)X,{z))/G(z). 

By G(z) is denoted as Ai2{z)A2i{2.) - A^ 7(2)^22(2) • This 
gives a feedforward architecture for separation. How- 
ever, the simple feedforward architecture by itself does 

40 not result In the solution of equation (10). In addition to 
separation, it has the side^effect of whitening the out- 
puts. The whitening effect is avoided by using blind 
source separation system 40 of FIG. 6. 

In system 40, outputs before nonlinearities (approx- 

45 imation signals) are: 

t>,(^)= W,j{z)Xi(z)+ Wi2l^)U2{zl (11) 

Up(z)= W22(Z)X2(Z)+ W21{Z)U,(Z), 

50 

Using equations (9) and (11) and designating adaptive 
filter 42 as 1^,, . adaptive filter 43 as W22. adaptive filter 
46 as W12, anti adaptive filter 47 as IV^/* ^ solution for 
perfect separation and deconvolution becomes: 

55 

W,,{z) = A„(z)'\ W,2(z) = -A ,2(z)A „(z)-\ 

W22{Z) = A22{zy\ W2i{z) = 'A2i{z)A22{zy\ 
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By forcing ^V,, = W22 « 1 . the entropy at the output 
can be maximized without whitening the sources. In this 
case W11 and W22 have the following solutions: 

lV„(z) = 1. lV,p(2) = 2(2)^22(2) 

The adaptation equations for blind source separa- 
tion system 40 of FIG. 6 are derived below using, for 
simplicity, only two sources. In the following equations. 
Wiffi denotes the weight associated with delay k from 
mixture / to approximation signal /. and wy^- denotes the 
weight associated with delay k from approximation sig- 
nal j to approximation signal /. Assuming FIR filters for 
Wg, In the time domain the network carries out the fol- 
lowing: 

ft » 0 ft = 1 

'■22 ^-21 

k-0 ftsi 



For the Jacobian. 

ln\J\ = /n(y;)-h/n(y2)+/n(D) 
= ln{y^ ) + In{y2) + /^(w^oti^^o^)- 

There will now be three different cases: zero delay 
weights in direct filters, other weights in direct filters, 
and weights in feedback cross-filters. Following the 
steps in previous derivations for ail these cases: 

^^/o/*" (1-2y/)^/ + l/w;^/. 

AM^/w« (1-2y,)x/(f ./c). 

A'^z/tf* (1-2y;)Uy(/- /f). 

The zero delay weights again scale the data to maxi- 
mize the information passed through the sigmoid, other 
weights in the direct branches of the network decorre- 
late each output from the corresponding input mixture 
(whitening), and the weights of the feedback branches 
decorrelate each output y,- from all of the other sources 
(approximation signals uj) at every time instant within 
the scope of the filters / - k (separation). 

While this embodiment is disclosed using FIR fil- 
ters, it will be understood by those skilled in the art that 
recursive filters (generally krx>wn as MR filters) could be 
utilized instead and the adaption rules can be derived in 
the same way (as explained above). 

Accordingly, a new and novel blind source separa- 
tion system is disclosed that operates under real world 



conditions. The new and improved t)lind source separa- 
tion system has the capabilities of dealing with sources 
that have been delayed with respect to each other and 
is capable of separating sources which include a sum of 

£ multipath copies of the sources distorted by the environ- 
ment, which is not possible in prior art systems. 

While I have sh^n and described specif tc embod- 
iments of the present invention, further modifications 
and improvements will occur to those skilled in the art. I 

TO desire It to be understood, therefore, that this invention 
is not limited to the particular forms shown and I intend 
in the appended claims to cover all modifications tiiat do 
not depart from the spirit and scope of this invention. 

IS Claims 

1 . A method of recovering a plurality of source signals 
(y1 . y2) from an equal plurality of mixed signals (x1 , 
x2), each mixed signal including components of the 

20 source signals, characterized by the steps of: 

multiplying a channel one mixed signal (x1) by 
a channel one adaptive weight (w1) to produce 
a channel one product signal; 

25 multiplying a channel two mixed signal (x2) by 

a channel two adaptive weight (w2) to produce 
a channel two product signal; 
generating a channel one filtered feedback sig- 
nal from a channel two approximation signal 

30 (u2): 

generating a channel two filtered feedback sig- 
nal from a channel one approximation signal 
(u1); 

adding (32) the channel one filtered feedt>ack 
35 signal to the channel one product signal to pro- 

duce the channel one approximation signal 
(ul); 

adding (33) the channel two filtered feedback 
signal to the channel two product signal to pro- 
40 duce the channel two approximation signal 

(u2): 

applying a nonlinear function (48, 49) to the 
channel one and channel two approximation 
signals (u1, u2) to produce the channel one 
45 and channel two output signals (y1 . y2); and 

adjusting (50) the channel one adaptive weight 
(w1), the channel one filtered feedback signal 
(d12, W12, w01). the channel two adaptive 
weight (w2), and the channel two f Htered feed- 
so back signal (d2l. W21. w02), to maximize 
entropy of the channel one and the channel two 
output signals (y1. y2), thereby recovering a 
first source signal (y1) as the channel one out- 
put signal (y1) and a second source signal (y2) 
55 as the channel two output signal (y2). 

2. A method of recovering a plurality of source signals 
from an equal plurality of mixed signals as claimed 
in daim 1 wherein the step of adding the channel 
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one tittered feedback signal to the channel one 
product signal is further characterized by. adding a 
channel one t^ias weight (wOl) and the step of add- 
ing the channel two filtered feedback signal to the 
channel two product signal includes, in addition, 5 
adding a channel two bias weight (w02). 

3. A method of recovering a plurality of source signals 
from an equal pluralrty of mixed signals as claimed 

in claim 1 wherein the step of generating the Chan- 10 
nel one filtered feedback signal is further character- 
ized by delaying (d12) the channel two 
approximation signal and multiplying the delayed 
signal by a channel one feedback weight (w12). 

IS 

4. A method of recovering a pluralrty of source signals 
from an equal plurality of mixed signals as claimed 
in claim 3 wherein the step of generating the chan- 
nel two filtered feedt>ack signal is further character- 
ized by delaying (d21) the channel one 20 
approximation signal and multiplying the delayed 
signal by a channel two feedback weight (w21). 

5. A method of recovering a plurality of source signals 
from an equal plurality of mixed signals as claimed 2s 
in claim 4 wherein the step of adjusting (37) the 
channel one adaptive weight and the channel two 
adaptive weight is further characterized by adjust- 
ing the weights in accadance with the following 
equations 30 

AlV,oc(l.2y,)Xi+^ 

1 

A»V20c(i.2y2)x2+— 

where: 

40 

W'^ and W2 are the channel one and channel 
two adaptive weights; 

and xz are channel one and channel two 
mixed signals: and 

and y2 are first and second output signals. 45 

6. A method of recovering a plurality of source signals 
from an equal pluralrty of mixed signals as claimed 
in claim 5 wherein the step of adjusting the channel 
one and tiie channel two filtered feedback signals is so 
further characterized by adjusting the channel one 
and channel two feedback weights in accordance 
with the following equations 

Aw^2'"(1-2yi)(y2(t-o^i2) ^- 
Aw2i«(1-2y2)i/i(t.<y2i) 

where: 



1^ 

w^2 ^21 the channel one and channel 
two feedback weights; 

and U2 are channel one and channel two 
approximation signals; 

y^ and y2 are first and second output signals; 
and 

d^2 end c/21 amounts the channel one and 
channel two approximation signals are 
delayed. 

7. A method of recovering a plurality of source signals 
from an equal plurality of mixed signals as claimed 
in claim 6 wherein the step of adjusting tiie channel 
one and the channel two f Htered feedback signals is 
further characterized by adjusting the amounts tfie 
channel one and channel two approximation sig- 
nals are delayed in accordance with the following 
equations 

^^i2«-(l-2yi)«Vi2U20-c'i2) 
Ad2i « -{1 -2y 2) W2^ 1 (t-cTai ) 

where: 

w^2 1^21 channel one and channel 

two feedback weights; 

and U2 are time derivatives of channel one 
and channel two approximation signals: 
y^ and y2 are first and second output signals; 
and 

d'i2 and 0^21 are the amount of delay in the 
channel one and channel two filtered feedback 
signals. 

8. A method of recovering a plurality of source signals 
from an equal plurality of mixed signals as claimed 
in claim 1 wherein the steps of multiplying the chan- 
nel one mixed signal by the channel one adaptive 
weight and multiplying the channel two mixed signal 
by the channel two adaptive weight are further 
characterized by providing digital channel one and 
channel two mixed signals and providing digital 
channel one and channel two adaptive weights. 

9. A method of recovering a plurality of source signals 
from an equal plurality of mixed signals as claimed 
in daim 1 wherein the step of multiplying the chan- 
nel one mixed signal (xl) by the channel one adap- 
tive weight (w1) to produce the channel one product 
signal is further characterized by multiplying the 
channel one mixed signal by a series of different 
weights (42) associated with a series of different 
delays and doing a summation to produce the 
channel one product signal and the step of multiply- 
ing the channel two mixed signal (x2) by the chan- 
nel two adaptive weight (w2) to produce the 
channel two product signal includes multiplying the 
channel two mixed signal by a series of different 
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weights (43) associated with a series of different 
delays and doing a summation to produce the 
channel two product signal. 

10. A method of recovering a plurality of source signals s 
from an equal plurality of mixed signals as claimed 
in claim 9 wherein the step of generating the chan- 
nel one filtered feedback signal is further character- 
ized by multiplying the channel two approximation 
signal (02) by a series of different weights (46) io 
associated with a series of different delays ar.d 
doing a summation (44) to produce the channel one 
filtered feedback signal and the step of generating 
the channel two filtered feedback signal includes 
multiplying the channel one approximation signal is 
(ul) by a series of different weights (47) associated 
with a series of different delays and doing a sum- 
nnation (45) to produce the channel two filtered 
feedback signal. 
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